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DECODER AND METHOD OF DECODING USING PSEUDO TWO PASS 
DECODING AND ONE PASS ENCODING 

FIELD OF THE INVENTION 

The present invention relates to a decoder and a method and system of video data 
decoding, and in particular the decoding of MPEG video bitstreams, that provides memory 
savings in frame buffers. 

BACKGROUND OF THE INVENTION 

There is a continuous need for reducing the memory requirements of a video decoder in 
order to reduce costs. However, it is also expected that the subjective quality of the 
decoded video will not deteriorate as a result. Memory reductions (for example in the ratio 
of 10:1 or higher) will also enable the effective embedding of memory components within 
a hardware decoder system component, similar to the embedded dynamic random access 
memory ("embedded DRAM' 1 ) technology. 

For example, a typical video decoder chip like an MPEG-2 decoder uses a significant 
amount of memory for storing the data in frame buffers to be used for decoding temporally 
linked video frames, video post-processing and for storing on-screen display information 
for feature enhancements. The reduction of memory requirements, especially in relation to 
video decoding and post-processing, has been the subject of much research since it can 
provide significant savings in manufacturing costs. 

Memory reduction with decimation in the spatial domain causes blurring of the image 
while decimation in the frequency domain by applying a fixed bit rate to encode a 
macroblock or block, as suggested in the prior art, causes unpredictable artefacts which are 
especially apparent in fast moving video sequences. 



Another challenge of recompression is the precision of bit rate control. Since the size of 
the physical memory to be used in a system may be fixed, the rate control of the variable- 
length encoding circuit (or entropy encoding) must be accurate, such that the maximum 
memory is utilized without exceeding the allocated memory size. Known methods such as 
virtual-buffer-fullness control may not be used independently since the variations in the 
generation of bits would not be ideal for a fixed and maximally utilised memory buffer. A 
tighter control of accuracy for the virtual- buffer-fullness method results in the degradation 
of picture quality, while better picture quality is associated with a high variation in the bit 
rate. 

SUMMARY OF THE INVENTION 

The present invention provides a method of processing video frame data, including the 
steps of: 

(a) receiving a video frame; 

(b) partially decoding the video frame; 

(c) fully decoding the video frame to produce macroblocks; 

(d) determining video data parameters from the partially decoded video frame 
or both the partially and fully decoded video frame; 

(e) encoding the macroblocks based on the determined video data parameters to 
provide a compressed video frame for subsequent display. 

In another aspect, the invention provides a video decoder adapted to perform the above 
method. 

The present invention further provides a video decoder including: 

(a) a bitstream parser for receiving a video frame; 

(b) an embedded decoder for partially decoding the video frame and fully 
decoding the video frame to produce macroblocks; 

(c) a data analyzer for determining video data parameters from the partially 
decoded video frame or both the partially and fully decoded video frame; 

(d) an embedded encoder for encoding the macroblocks based on the 
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determined video data. 

To achieve a significant compression ratio while rendering acceptable picture quality and 
minimizing implementation complexity, the present invention provides a method of 
5 applying pseudo two-pass decoding and one-pass encoding of input video data. In the first 
pass of the two-pass decoding process, the input video bitstream is decoded partially to 
extract useful picture statistics for use in the subsequent one pass encoding process. The 
second pass of die two-pass decoding process is performed in parallel with the one-pass 
encoding process, which allows the storage of the decoded picture within a target-reduced 
1 0 amount of memory. 

The preferred embodiment re-encodes each anchor frame (which may contain either an I- 
Picture or P-Picture) as an I-Picture to the desired memory compression ratio with 
minimum trade-off in picture quality and system complexity. Also, for cases where the 
15 display resolution is less than the bitstream resolution, a non-anchor picture (i.e. a B- 
Picture) can be decoded on-the-fly using a two-pass decoding technique to significantly 
reduce the overall memory requirements of the system. 

In the case of a standard MPEG decoder, the one-pass encoding process takes the 
techniques of standard intra macroblock encoding with Discrete Cosine Transform 
("DCT"), quantization, the scanning of DCT coefficients in a zig-zag pattern, and 
Variable-Length Coding ("VLC"). To minimise picture degradation and maximise the 
useful picture statistics that can be extracted during the first pass of the two-pass decoding 
process in the present invention for all frames, the one-pass encoding process used in a 
preferred embodiment utilises encoding techniques similar to that described for a standard 
MPEG encoder. 

Embodiments of the invention also relate to a system for performing two-tiered rate control 
that re-compresses video data using present compression techniques. Based on the picture 
30 statistics derived from the first pass of the two-pass decoding process, the two-tiered rate 
control scheme is applied to the one-pass encoding process to determine the quantizer scale 



for efficient bit allocation. The determination of a suitable quantizer scale enables 
effective compression while maintaining good picture quality. Artefacts caused by the 
dropping of DCT coefficients during quantization are significantly reduced since 
decimation in the frequency domain is mostly performed within the ideal compression 
limit of the system, but rarely within the expansion range of the quantization process. 
Typically, the compression scheme supports a 10: 1 memory reduction per frame buffer. 

In addition, the rate control scheme is able to stabilise the bit rate generation of the 
compression scheme and maintain variations in the bit rate generally within 10% of the 
average bit rate. This rate control accuracy makes the present system suitable for use in 
systems with fixed memory buffers. Hence a video decoder with an embedded memory 
system may be built in accordance with the principles of the present invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Preferred embodiments of the present invention are hereinafter described, by way of 
example only, with reference to the accompanying drawings, wherein: 

FIG. 1 is an illustration of the decoding of an interpolated macroblock in the B- 
Picture; 

FIG. 2 is a flow diagram illustrating the interaction of various modules employed in 
a compression scheme of an embodiment of the present invention; 

FIG. 3 is an example of an implementation architecture of a reduced memory video 
decoder of an embodiment of the present invention; 

FIG. 4 is a timing diagram illustrating an example of how the present invention 
processes a MPEG-2 video bitstream with a frame encoding sequence of {I, P, B, ...}; 

FIG. 5 A is a graphical representation of the normal case of maximal overlap of the 
predicted macroblock on the macroblock grid of compressed frame; 

FIG. 5B is a graphical representation of the boundary case of equal overlap on 4 
macroblocks; 

FIG. 5C is a graphical representation of the boundary case of equal overlap on 2 of 
the 4 macroblocks; 
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FIG. 6 is a block diagram of a rate control circuit according to an embodiment of 
the invention; 

FIG. 7 is a block diagram of the embedded encoder module shown in Figure 3; 
FIG. 8 is a block diagram of a decoder of another embodiment of the present 
5 invention that supports lower resolution picture or zoom-out picture decoding. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS OF THE 
INVENTION 

Embodiments of the present invention are applicable to an MPEG-2 video decoder. The 
MPEG-2 specifications (also referred to as "ISO/IEC 13818") achieves significant 
compression by removing temporal redundancy between frames close in time. This is 
done in addition to removing spatial and statistical redundancy within a frame by DCT or 
entropy encoding and lossy compression by quantization. The temporal element implies 
that the encoding of a frame is not limited to information within the frame itself but 
information that may span across several pictures. In MPEG-2, the term "picture" refers to 
either a frame or a field. Therefore, a coded representation of a picture may be 
reconstructed into a frame or a field. 

20 Figure 1 illustrates an example of MPEG decoding of a macroblock in a B-Picture 202, 
which in this example requires forward prediction from an I-Picture 201 and backward 
prediction from a P-Picture 203. The sequence of frames 204 reflects the order in which 
the frames will be displayed, starting from the T-Picture 201. An I-Picture 201 (short for 
"intra picture") is encoded purely with information within the picture. A P-Picture 203 

25 (short for "predicted picture") is encoded with information from an earlier I-Picture 201, or 
from an earlier P-Picture, in addition to information representing the current frame. A B- 
Picture 202 (short for "bidirectional picture") is encoded with information from both or 
either of an I-Picture 201 and P-Picture 203 to be displayed earlier and later than the 
current B-Picture 202. Even with "B-on-the-Fly" decoding, which involves the direct 

30 decoding of B-Picture bitstreams for display without intermediate storage, at least two 
anchor frames (i.e. an [-Picture or P-Picture) are required. Each anchor frame has a 
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maximum size of approximately 5 megabits (derived by: 720 horizontal pixels x 576 lines 
x 1.5 bytes per pixel x 8 bits per byte = 5 megabits) in the case of a PAL picture of Dl 
resolution. 

It is desired to re-encode each anchor frame (i.e. an I-Picture or P-Picture) as an I-Picture 
to the desired memory compression ratio with minimum trade-off in picture quality and 
system complexity. 

Figure 2 shows the general operation of the memory reduction scheme in the decoder of a 
preferred embodiment. The MPEG video bitstream is partially decoded by a Bitstream 
Parser circuit 301, which applies variable-length decoding on the video bitstream to obtain 
the quantized DCT coefficients and macroblock information for all macrobiocks and 
related picture information in each frame being processed. This* is the first pass of the two- 
pass decoding process. The information from the partially decoded MPEG video bitstream 
is passed to a Data Analyzer circuit 302, which further extracts picture statistics and 
macroblock information in relation to each frame being processed. The Bitstream Parser 
301 retrieves macroblock and picture information from the pictures stored in compressed 
frame buffers and the Data Analyzer circuit 302 uses this further macroblock information 
and picture statistics as described later. 

An MPEG-2 Decoder circuit 303 completely decodes the MPEG video bitstream to 
produce macrobiocks, which are later re-encoded by an Embedded Encoder 308 for storage 
in the compressed frame buffers and referenced by an address. The stored macrobiocks 
may be later retrieved from memory for the motion compensation of predicted 
macrobiocks, which may be decoded from later frames, thus forming the final pixel values 
in preparation for display. At the same time, macroblock information is passed to the Data 
Analyzer 302 as it is generated by the MPEG-2 Decoder 303. The Data Analyzer 302 uses 
more information from decoding (not shown) of the compressed frame buffers and 
computes important macroblock parameters (described below). 
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A rate control circuit 304 then uses the earlier computed picture statistics and macroblock 
parameters from the Data Analyzer circuit 302 to derive a suitable quantizer scale for the 
Embedded Encoder 308. A Macroblock Bit Allocation circuit 305 first allocates the target 
macroblock bits based on the scaled macroblock complexity. The bit allocation process 
5 allocates the number of bits to be used for encoding the AC coefficients of each 
macroblock using scaled macroblock complexity together with adjustments from a 
proportional and integral error feedback controller. 

The equation governing the bit allocation process is given as follows: 

10 




where sjis the target number of bits for encoding AC coefficients for the /* macroblock; 
X t is the estimated complexity for the I th macroblock; 
X piC is the estimated complexity from current picture statistics; 
s 7 ^ is the target bits for encoding all AC coefficients from current picture 
statistics; 

e M is the number of bits for encoding the error of the AC coefficients for the (/-/)* 
macroblock; 

J] e k is the accumulation of the number of bits for encoding the error of the AC 

kmO 

coefficients from the 0 lh macroblock up to the (i-l)^ macroblock; 

7] is the local proportional error feedback control constant; and 
y is the integral error feedback control constant. 

25 For the present system the macroblock complexity, x M generally defined as: 



15 



20 



X = s + q 



where s is the number of bits used for encoding AC coefficients of a macroblock; and 
q is the quantizer scale used for the macroblock. 

The process of scaled macroblock complexity bit allocation is developed on the finding 
that the macroblock complexity is relatively constant over a range of quantizer scales. A 
smaller quantizer scale generates more bits for encoding the AC coefficients of the same 
macroblock while a macroblock with higher complexity requires more bits for encoding its 
AC coefficients for the same quantizer scale. 

The decoder differentiates between the number of bits generated by the AC and DC 
coefficients. As DC coefficients affect the contrast of the picture, it is critical that the 
recompression technique used in the Embedded Encoder 308 uses the same intra-DC 
precision and prevents any further loss of information. This differentiation also benefits 
the second process in the rate control scheme, known as the quantizer scale prediction. 

A Quantizer Scale Prediction circuit 306 then predicts the corresponding quantizer scale to 
be used in encoding the AC coefficients of each macroblock using an inverse complexity 
relation with adjustments made by mismatch control. The equation governing the 
quantizer scale determination is given as follows: 

q, -4- + «M+£Z>* 

where q i is the predicted quantizer scale for the I th macroblock; 
estimated complexity of the /* macroblock; 

r 

' is the target number of bits used for encoding AC coefficients for the i* 
macroblock; 

is the number of bits for encoding the error of the AC coefficients for the (I'-i)* 
macroblock; 
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1-1 

is the accumulation of the number of bits for encoding the error of the AC 

coefficients from the 0 th macroblock up to (/-/)* macroblock; 

a is the local proportional error feedback control constant; and 
(3 is the integral error feedback control constant. 

5 

In addition, normalization may be applied to the macroblock complexity, where the 
normalised macroblock complexity, % t , is given by: 

10 

where z IS the average macroblock complexity of the previous re-encoded picture. 
Normalization is used to achieve better subjective quality and higher rate control accuracy. 
Normalized complexity reduces the differences between macroblock complexities, giving 
a higher rate control accuracy. In addition, high complexity regions are quantized coarser 
15 without subjective compromise, translating into bit savings for sensitive low complexity 
regions that are quantized finer, and thus achieving a better subjective quality. 
Quantization comparison is made between the normalized and non-normalized macroblock 
complexity. 

20 The rate control accuracy is guaranteed by a Feedback Control circuit 307 that implements 
a two-tier proportional integral ("PI") control loop (illustrated in Figure 6). The inner loop 
tightly controls the quantizer scale prediction accuracy at die macroblock level, while the 
outer loop compensates for the offset created by the inner loop and converges the encoding 
bit count to the target picture bit count. 

25 

With the derived quantizer scale from the Rate Control circuit 304 and the encoding 
parameters from the Data Analyzer 302, the Embedded Encoder 308 encodes the stream of 
decoded pixel values from the MPEG Decoder 303 via the various video compression 
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techniques in the MPEG-2 specifications, namely DCT, quantization and variable-length 
encoding, to form a video bitstream for storage in the compressed frame buffers. 

Preferably, the Rate Control circuit 304 works in real-time, such that the Feedback Control 
circuit 307 receives the actual bit count of the video stream as it is leaving the Embedded 
Encoder 308 and makes any adjustments using the Macroblock Bit Allocation circuit 305 
or Quantizer Scale Prediction circuit 306 for the next macroblock in the pipeline. 

Figure 3 shows an embodiment of the decoder, illustrating an example of an 
implementation architecture of B-on-the-Fly MPEG video stream decoding working in 
conjunction with a system providing reduced memory MPEG video stream decoding. To 
illustrate how the system operates, it is assumed that the system will process a MPEG-2 
video bitstream consisting of frames in the display sequence {I, B, P, ...}, with a 
corresponding frame encoding sequence of {I, P, B, ...}. The video bitstream is received 
and stored in a Bitstream Buffer 401. After the required Video Buffering Verifier 
("VBV") delay, as defined in the MPEG-2 specifications, the bitstream for the entire 
picture is stored in the Bitstream Buffer 401 and ready for decoding. 

The decoding of each picture is performed by a pseudo two-pass decoding and one-pass 
encoding process, where the first phase of the two-pass decoding process, represented by a 
first field time of a frame to be processed, involves extracting macroblock and picture 
information and computing picture statistics (described below) for the current frame. The 
second phase of the two-pass decoding process (represented by a second field time of the 
frame to be processed) involves extracting macroblock information for the current frame 
and also the complete decoding of the current frame. The second phase is performed in 
parallel with the one-pass encoding for the same frame. The encoded video data is then 
stored in compressed frame buffers 407. 

In a first field time of the first frame, t|, a Bitstream Parser 402 decodes the first I-Picture 
sufficiently for a Data Analyzer 403 to perform picture statistics computations. In a 
second field time of the first frame, t2, a MPEG Decoder 404 decodes the first I-Picture 
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completely and feeds forward information to the Data Analyzer 403 which computes 
macroblock characteristics. In the same time period, a Rate Control circuit 405 uses the 
computed parameters to determine a suitable quantizer scale. An Embedded Encoder 406 
encodes the original I-Picture as a new I-Picture using the parameters from both the Data 
5 Analyzer 403 and the Rate Control circuit 405 at a macroblock latency relative to the 
MPEG Decoder 404. The final video bitstreams are stored in the Compressed Frame 
Buffers 407 and the address location of each macroblock in the Compressed Frame Buffer 
407 is mapped into a Macroblock Pointer Table. 

10 In a first field time of the second frame, tj, the Bitstream Parser 402 decodes the P-Picture 
in the second frame sufficiently for the Data Analyzer 403 to perform picture statistics 
computations The decoding of the P-Picture is similar to I-Pictures except that the motion 
vectors are used to locate predicted macroblock properties, thereby providing a good 
estimate for the current inter-coded macroblock properties. Reference herein shall be 

15 made to a top- field first video image sequence. It is assumed that the processing of all 
video images begins from line 0, corresponding to the first line of an image. At the same 
time a Display Decoder 408 decodes the top field (or only the even-numbered lines) of the 
I-Picture retrieved from the Compressed Frame Buffers 407 and passes the decoded picture 
to the Standard Display 409 for further processing before it is displayed. In a second field 

20 time of the second frame, t*, the operations of the P-Picture are similar to that for the I- 
Picture (i.e. it is encoded by the Embedded Encoder 406 as a new I-Picture and then stored 
in the Compressed Frame Buffers 407), except that the motion vectors of the P-Picture as 
decoded by the MPEG Decoder 404 are used to locate the corresponding predicted 
macroblocks in the Compressed Frame Buffers 407 using the Macroblock Pointer Table. 

25 The located reference macroblocks are retrieved and decoded by an Embedded Decoder 
410, which operates concurrently with the MPEG Decoder 404 to produce the predicted 
pixel values for the motion compensated picture. In the case of I-Pictures, which has 
concealed motion vectors, a similar procedure like that for P-Pictures is followed. At the 
same time, the Display Decoder 408 decodes the bottom field (or only the odd-numbered 

30 lines) of the I-Picture from the Compressed Frame Buffers 407 and passes the decoded 
picture to a Standard Display 409 for further processing before it is displayed. 
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In a first field time of the third frame, t5, the MPEG Decoder 404 decodes the video 
bitstream of the B-Picture in the Bitstream Buffer 401. However in the case of a B-frame 
picture, only macroblocks of selected motion vectors representative of the top field (i.e. 
only the even-numbered lines) are decoded. The motion compensated top field pixels are 
transmitted to the Standard Display 408 for further processing before the top field is 
displayed. A similar operation is performed to the bottom field (i.e. only the odd- 
numbered lines) during a second field time of the third frame, t<5. This method of direct 
decoding B-Picture bitstreams for display without requiring intermediate storage is known 
as "B-on-the-Fly". 

The present invention only requires two anchor frames at any one time. Where a further 
anchor frame appears in the Group Of Pictures ("GOP") sequence, the new anchor frame is 
encoded as a new I-Picture and stored in the Compressed Frame Buffers 407 by replacing 
the earlier of the encoded I-Picture or P-Picture already stored in the Compressed Frame 
Buffers 407. 

Figure 4 is a timing diagram illustrating an example of how the present invention processes 
a MPEG-2 video bitstream with a frame encoding sequence of {I, P, B, ...}. The frame 
encoding sequence in this example also reflects the order in which the frames will be 
decoded, ti 901 is the first field time of the first frame, and represents the time interval in 
which the I-Picture in the first frame is decoded for picture statistics. 12 902 is the second 
field time of the first frame, and represents the time interval in which the I-Picture in the 
first frame is fully decoded and re-encoded as a new I-Picture before it is stored in the 
Compressed Frame Buffers. 

t 3 903 is the first field time of the second frame, and represents the time interval in which 
the P-Picture in the second frame is decoded for picture statistics. During the interval t3, 
the top field of the I-Picture from the first frame, Il t , is retrieved from the Compressed 
Frame Buffers and decoded by the Display Decoder in preparation for display. U 904 is 
the second time field of the second frame, and represents the time interval in which the P- 
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Picture in the second frame is fully decoded and re-encoded as a new 1-Picture before it is 
stored in the Compressed Frame Buffers. During the interval U, the bottom field of the I- 
Picture from the first frame, II b , is retrieved from the Compressed Frame Buffers and 
decoded by the Display Decoder in preparation for display. 

t 5 905 is the first field time of the third frame, and represents the time interval in which the 
top field of the B-Picture in the third frame is decoded by the Embedded Decoder (by 
retrieving from the Compressed Frame Buffers only those macroblocks representing the 
top field of the current B-Picture, B3 t , as defined by the motion vectors in the current B- 
Frame) and then decoded by the Display Decoder for immediate display. t6 is the second 
time field of the third frame, and performs the same functionality described for ti but is 
applied in respect of the bottom field of the B-Picture in the third frame, B3b. 

During the first field time of an I-Picture or a P-Picture, the Bitstream Parser 402 variable- 
length decodes the video bitstreams after removing the numerous headers (including those 
headers that define a sequence, GOP, picture, slice, or macroblock) and extracts the 
following picture parameters for storage and macroblock parameters for further processing t 
in Data Analyzer 403. 

Picture parameters: 

• q_scale_type, the type of quantization table used (linear or non linear); 

• Intra Quantizer Matrix, the two dimensional 8x8 quantization table used for 

intra-coding; 

• intra _DC ^precision, the number of bits used for coding DC coefficients; 

• alternate jscan, the type of zig-zag scan to perform; and 

• intra_ylc Jbrmat, the type of variable length coding table used for intra- 

coding. 

Macroblock parameters: 

• sf 9 the bit count of AC coefficients: 
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• df , the bit count of DC coefficients; 

• q h t , the quantizer scale; 

• {{ mv * }juo }* > toe set °f K full scale motion vectors decoded from the 
associated motion vector information; and 

• mbjntra, the boolean representation of intra-coded macroblocks. 

The parameters q_scalejype, intraJDC precision, alternate _scan, intra_vlc Jbrmat and 
mbjntra are defined in the MPEG-2 Specifications. 

Preferably, the macroblock parameters are processed in the Data Analyzer 403 as 
information is extracted from the Bitstream Parser 402 during the first pass decoding and 
the MPEG Decoder 404 during the second pass decoding. The Bitstream Parser 402 or the 
MPEG Decoder 404 might not give the exact list of parameters desired since some of the 
parameters have to be computed outside the MPEG Decoder 404. For example, the bit 
count of AC coefficients can be computed from the difference between the bitstream 
pointer from the first AC coefficient decoding to, and not inclusive of, the end of block 
code. In addition, some of the macroblock parameters are computed from the extracted 
parameters and some are accumulated to form picture parameters. 

If the macroblock is intra-coded (i.e. if mb_xntra = 1), the estimated macroblock 
complexity, %, , and the estimated bit count of DC coefficient, d t , will be defined as 
follows: 

If the macroblock is inter-coded or if the prediction error is coded (i.e. if mbjntra = 0), the 
estimated macroblock complexity, x t , and the estimated DC coefficients bit count, d t , 
will be defined as follows: 
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X, 
d =d\ 

where and d^'are the bit count of AC coefficients, the quantizer scale and the bit 

5 count of DC coefficients respectively, as derived from the Compressed Frame Buffer 407. 
Statistical data are gathered from the Compressed Frame Buffers 407 rather than from the 
Bitstream Buffer 401 for inter-coded macroblocks, since the predicted macroblocks 
provide a closer image description to the original macroblock than the prediction error. 

The set of motion vectors, {{mv k }*~* }* , is used to locate the predicted macroblocks using 
10 the address references in the Macroblock Pointer Table. 

For the equations in this specification, the b superscript represents information derived 
from the Bitstream Buffer 401 while the c superscript represents information from the 
Compressed Frame Buffers 407. Thus, for example, d t can be represented by d* or d c t , 
15 depending on whether the macroblocks to which d t relates are intra-coded or not (i.e. 
whether mb_intra = 1 for those macroblocks). 

Each macroblock is variable-length encoded and has a pointer reference to the start of the 
macroblock for easy reference in motion compensation. Reference herein is being made to 
a PAL picture (720 pixels x 576 lines) of Dl resolution. A macroblock defines a two 
dimensional region consisting of a 16 x 16 pixel array in the video image. Each picture 
thus requires a Macroblock Pointer Table with a maximum of 1620 entries( where 45 
macroblocks per line * 36 macroblocks per column = 1620 macroblock entries). A 
possible implementation with memory saving is to have a hierarchical pointer system 
implemented in the Macroblock Pointer Table. For example, the picture is divided into 
video segments, such that each video segment consists of five consecutive macroblocks. 
Each picture should have 324 full segment pointers (1620 macroblocks per picture / 5 
macroblocks per video segment = 324 segments) and four incremental macroblock pointers 
per segment, where each incremental macroblock pointer points to a macroblock relative to 
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the previous raacroblock within that segment. Hence, for a 4:2:0 chroma sampling format, 
the largest macroblock size would be 3072 bits (8x8 pixels per block * 6 blocks per 
macroblock * 8 bits per pixel = 3072 bits per macroblock) and the largest segment size 
would be 15,360 bits (3072 bits per macroblock * 5 macroblocks per video segment = 
15,360 bits) and the largest picture size would be 4,976,640 bits (3072 bits per macroblock 
* 1620 macroblocks per picture = 4,976,640 bits). Assuming that the compression does 
not expand the original pixel data, a 12 and 23 bit precision is defined for an incremental 
macroblock pointer and a full segment pointer respectively. As a result, a minimum of 
23,004 bits (324 segments per picture * (23 bits per full segment pointer + 12 bits per 
incremental segment pointer * 4 incremental segmental pointers per segment) = 23,004 
bits) is required to implement the Macroblock Pointer Table. Preferably, an 8x8 block 
pointer system that provides a finer resolution is not used since it requires an additional 9 
bits per block (capped by the amount of uncompressed data per block) and amounts up to 
an additional 72,900 bits (9 bits per block * 5 incremental block pointers per macroblock * 
1620 macroblocks per picture = 72,900 bits) of memory. 

By first identifying the segment, k, within which the macroblock, m, is located and each 
macroblock has a positional offset, n, it is possible to calculate the address of a predicted 
macroblock as follows: 

i-i 

mb _ address m = segment _ address k + ^ mb _ address _ inc t 

tmQ 

where mb_address m is the absolute macroblock address of macroblock m\ 

segment jzddressk is the full segment address of segment k\ and 
mb_address_jnc t is the incremental macroblock address of a macroblock with a 
position offset / within a segment k y and where / is an integer ranging from 0 to 
n-1 and n represents the number of macroblocks within a segment. 

In contrast to the pixel resolution determined from the motion compensation scheme in a 
normal MPEG Decoder, macroblock resolution is used in the present decoder. Inter-coded 
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macrobiock properties are derived using motion vectors on the macroblock grid or a two 
dimensional boundary. 

Figures 4A, 4B and 4C illustrate examples of a predicted macroblock on the macroblock 
5 grid. As shown in Figure 5 A, the predicted macroblock has a maximal overlap of pixels in 
macroblock D. The estimated macroblock complexity, x, > estimated bit count of 

intra-DC coefficients for the inter-coded macroblock, d t , are defined as: 

10 d t =d c 0 

where , q c a , d c 0 correspond to the bit count of AC coefficients, the quantizer scale and 
the bit count of DC coefficients respectively, as derived from a simple decoding of 
macroblock D from the Compressed Frame Buffers 407. As shown in Figure 5B, if there 
15 is equal overlap on all macroblocks, any one of the four macroblocks will be used (for 
example macroblock D). As shown in Figure 5C, if there is overlap on only 2 
macroblocks, either one of the 2 macroblocks is used (for example macroblock B). A 
similar logic is applied at picture boundary conditions, 

20 However in the case of multiple motion vectors, the average complexity, jp",. and the 
average bit count of DC coefficients, d t , are taken over all motion vectors, and is 
represented by: 

d t = avgfa c k }™ 

25 

where xl ^1 respectively correspond to the macroblock complexity and the bit count 
of DC coefficients derived, as defined above for the A* motion vector, from the set of 



- 18- 



motion vectors {mv} b t and where K is the maximum number of motion vectors in the 

bitstream of a P-Picture according to the picture and motion prediction type, as tabulated in 
Table 1 below: 



Picture Type 


Prediction Type 


K 


Frame 


Frame 


1 




Field 


2 




Dual Prime 


4 


Field 


Field 


1 




16x8 


2 




Dual Prime 


' 2 



TABLE 1 

A similar procedure is derived for skipped macroblocks in the P-Picture by setting K = 1 
and the corresponding motion vector = 0. 

Referring again to Figure 3, the derived macroblock properties from the Compressed 
Frame Buffers 407 and the extracted macroblock properties from the Bitstream Parser 402 
are accumulated at a macroblock level in Data Analyzer 403. These macroblock properties 
are as follows: 

X t = X Xj » ^ e accumulated complexity; 

S t h = , the accumulated bit count of AC coefficients from the Bitstream 

Parser; 

D b k = ]TV* , the accumulated bit count of DC coefficients from the Bitstream 
Parser; and 
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D c t = , the accumulated bit count of DC coefficients from the Compressed 
Frame Buffers. 

When the last macroblock N-l of the picture has been reached, the picture complexity, 
5 x pw9 picture DC coefficients bit count from the Bitstream Parser 402, D* K , and the 

picture DC coefficients bit count from the Compressed Frame Buffers 407, D c ptc , are 

obtained as the result of accumulation. Other picture statistics are computed at the picture 
level by the equations below. 

10 The bit count of a picture's DC coefficients is calculated as follows: 

d pic = &p\c * V _<yro + D P ,c 

where X^-m* ls ^ e estimated compression factor of the DC coefficients bit count in the 
1 5 previous picture of the same type as described below. 

The target bit count of a picture's AC coefficients is calculated as follows: 

sT P ic 55 B l K -fl-dp* 

20 

where <f> is the overhead size (in bits) of the compression including the Macroblock 
Pointer Table, the quantizer jscale_code (a 5 bit parameter from the MPEG-2 
Specification) and the dctjype (a 1 bit parameter from the MPEG-2 Specification) for all 
macroblocks in the picture, and where B ptc is the target picture size. The quantizer scale is 

25 calculated from the quantizer _scalejcode and qjscalejype. The dctjype represents 
either performing the discrete cosine transform in frame format or field format. 
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During the second field time of an I-Picture or P-Picture, the MPEG Decoder 404 decodes 
the MPEG video bitstream. During the full decoding process, the macroblock parameter 
dctjype* and all the above mentioned macroblock parameters (other than the bit count of 

DC coefficients from the Bitstream Parser 402, df) are extracted, dctjype* indicates 

whether frame IDCT or field IDCT was performed during the decoding process and is 
useful for encoding (such as in the Embedded Encoder 406). The extraction of the above 
mentioned macroblock parameters (other than the bit count of DC coefficients and the dct- 
type) during the first pass encoding for each macroblock is preferably repeated in the full 
decoding process (i.e. the second decoding process) so as to save buffer space for storing 
macroblock values, although it is not necessary for it to be repeated. Macroblock 
complexity may be computed again as described above for the Rate Control circuit 405. 
Additional parameters, like dctjype and minjqscale, are preferably derived in the full 
decoding process. However, these two parameters may be derived in the Bitstream Parser 
402 during the first pass decoding and stored for use during the full decoding process. 
min_qscale represents the minimum quantizer scale used and is relevant for the Mismatch 
Control circuit 605 (described later in the text) for controlling the minimum quantizer scale 
to be used for embedded encoding. If the quantizer scale used is lower than the 
minjjscale, then there is no value added because quantization with a parameter smaller 
than the original encoded stream in the Bitstream Buffer 401 does not produce a better 
image quality. The bits saved in the process can be used for storing other macroblocks. 

For intra-coded macroblocks, 

dct _type t -dct^type* 
min_ qscale t - q h ( 

For inter-coded and skipped macroblocks, 



dct_type l ~dct _type\ 
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min_qscale t = min_qscale* 

The dctjype) and mmjjscale c , parameters correspond to the dct type and minimum 
quantizer scale parameters respectively, and are derived from the Compressed Frame 
Buffers 407 using the set of motion vectors {{/nv fc The c superscript represents 

information from the Compressed Frame Buffer 407. 



For one motion vector {mv 0 }* (with reference to Figure 5 A), dct _ type t is the dctjype of 



macroblock D and m \ n _qscale t is the minimum quantizer scale of the 4 or less 
macroblocks of interest. Both are derived as follows: 



dct _ type t = dctjype C D 
min _ qscale, = min }^ 

Similar derivations can be done where there is an equal overlap (as shown in Figures 4B 
and 4C) and for picture boundary conditions. 

In the case of K multiple motion vectors, 



default dct _ type £ dct _ type\ =K/2 



dct _ type , = 



*-0 

major _ _ /y/>e otherwise 



min _qscale t = min {minjgscale c k } *~q 

where dctjype\ refers to the DCT type derived for the # A motion vector, which is derived 
in a similar way to the case for the one motion vector above; default _dct_type refers to a 
fixed dctjype value assigned for cases where equal numbers of motion vectors have the 
same dctjype; major jictjype refers to the conformance to the majority of the dctjype 



that is derived by the set of motion vectors; and min _qscale t is the minimum minjqscale 
derived from the same set of motion vectors; and minjjscale c k refers to the minimum 

quantizer scale derived from the kf h motion vector, which is derived in a similar way to the 
case for the once motion vector above. 

In addition, referring to Figure 3, Data Analyzer 403 updates two parameters (i.e. the 
default jdctjtype and DC compression factor) at the picture level in the first or second field 
time for use in the subsequent pictures. 



default jictjype = 



f N-\ 

0 otherwise 



where //is the number of macroblocks in a picture and default jictjype is the majority of 
dctjype used for the macroblocks in the picture. 



The DC compression factor is calculated as follows: 



pic_type 



where picjype is an I-Picture or P-Picture, D h pic is the bit count of picture DC coefficients 
from the Bitstream Parser 402, and D r J£ is the bit count of picture DC coefficients from 

the re-encoded macroblocks that were intra-coded in the Bitstream Buffer 401. This 
compression factor is calculated for different picture types and may be used in the 
subsequent pictures of the same type. Typically, X p ^ typo can be initalized to 1. 

With the picture and macroblock statistical information, the Rate Control circuit 405 
derives a suitable quantizer scale for encoding. Figure 6 shows a functional block diagram 
of the rate control scheme. A Macroblock Bit Allocation circuit 601 (shown as 305 in 



Figure 2) allocates the number of bits to be used for encoding the AC coefficients of the 
macroblock according to scaled macroblock complexity, which is defined as follows: 



where 5*' is the target number of bits for encoding AC coefficients for the i macroblock; 

X 9 is the estimated complexity for the / th macroblock; 

X ptc is the estimated complexity from current picture statistics; 

Sp K is the target bits for encoding all AC coefficients from current picture 
statistics; and 

i-i 

% P tc = +y^ e k iS the proportional integral control adjustment for the picture 



The Qscale Prediction circuit 602 (shown as 306 in figure 2) then predicts the quantizer 
scale with the following equation: 



where q, is the predicted quantizer scale for the macroblock; 
estimated complexity of the i* macroblock; 

r 

1 is the target number of bits used for encoding AC coefficients for the / 
macroblock; and 




level. 



9, = ^r + 4m 




e k is the proportional integral control adjustment for the 



macroblock level. 



To stabilize bit rate generation and improve rate control accuracy, a two-tier control closed 
loop is implemented. The error, e t = - j* , defined as the difference between the target 

and re-encoded AC coefficient bit count, is fed back to outer and inner Proportional 
Integral (PI) control circuits 603 and 604 for the macroblock and picture level, 
respectively. The inner (macroblock) PI controller 604 compensates for the inaccuracies 
of the Qscale Prediction circuit 602 at the macroblock level and adds an error adjustment, 

calculated by ae,_, + J3^e k , to the predicted quantizer scale, q t , where a = -0.0008 and 

P = -0.0005 are example constant values. These values are exemplary values only. The 
bounds of these values are related to the convergence of the control loop. 

On the other hand, the outer (picture) PI controller 603 is concerned with the general 

stability of the bit rate generation and ensures the convergence of the target picture bit 

i-i 

count. It adds an error adjustment, calculated by Tje t _ x +y^e k , to the target AC 

Jt-0 

coefficient bit count before the scaled macroblock bit allocation takes place. In this case, 
example values can be rj - 0 and y « L5 since the impact of local error feedback is less 
than integral error feedback for stability purposes. These values are exemplary values 
only. The bounds of these values are related to the convergence of the control loop. 

Mismatch control is performed by a Mismatch Control circuit 605 and is performed after 
the quantizer scale prediction and error adjustments. The objective is to match the discrete 
set of quantizer scale values defined by qjscalejype and quantizer jscalejode in the 
MPEG specifications. First the Mismatch Control circuit 605 performs saturation on the 
incoming quantizer scale, q i , to the range of 2 to 62 for linear quantization (i.e. where 

qjscalejype = 0), and to the range of 1 to 112 for non-linear quantization (i.e. where 
qjscalejype =1). Then the Mismatch Control circuit 605 rounds the saturated quantizer 
scale to a discrete quantizer scale value according to the linear and non-linear quantization 
table. 
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In addition, the Mismatch Control circuit 605 compares the discrete quantizer scale to the 
minjjscale variable and forces the quantizer scale to equate with the minjqscale variable 
if the quantizer scale is larger than the value of minjqscale. This is to ensure that the 
Embedded Encoder (shown as item 406 in Figure 3) will encode with a quantizer scale no 
5 finer or smaller than its original quantizer scale as picture quality does not improve and 
encoding bits can be saved. 

However for I-Pictures, if the estimated bit count of picture AC coefficients, calculated by 
s* c -^Sj , is less than the target bit count of picture AC coefficients, s T pttm , the original 

10 quantizer scale, q T t , is used instead. 

In an alternative embodiment, a slight adaptation involving z, (or the normalized 

macroblock complexity) can be used instead of the macroblock complexity, x t . The 

reason is that high complexity macroblocks have image details that are not compromised 
15 subjectively by using a coarser quantization step size, whereas low complexity * 
macroblocks with smooth and homogenous areas that are more sensitive to the 
quantization step size and thus requires further quantization. 

Normalized complexity is defined as follows: 

20 

- _ 2*X,+X 
Xt ~* _ — 

where x is the average macroblock complexity of the previous re-encoded picture. 
Normalized complexity reduces the variation of macroblock complexity, raises the 
25 quantizer scale for higher complexity macroblocks and lowers the quantizer scale for low 
complexity macroblocks. The replacement of macroblock complexity, by the 
normalised complexity, z, 9 in all above steps concerning rate control achieves the 
advantage of having better subjective quality and higher rate control accuracy. 
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The Embedded Encoder (shown as item 406 in Figure 3) re-encodes all anchor frames 
(namely I-frames and P-frames) and all the components of the Embedded Encoder are 
shown in Figure 7. A Discrete Cosine Transform (DCT) circuit 701 performs a two 
dimensional 8x8 DCT on the pixel output of the decoded video bitstream from the MPEG 
Decoder (shown as item 404 in Figure 3). For a frame picture, a frame DCT is performed 
if the dctjype is determined to be 0 in the Data Analyzer (shown as item 403 in Figure 3), 
otherwise a field DCT is performed. The resultant DCT coefficients are quantized by a 
Quantizer (Q) circuit 702 using the 8x8 intra-quantizer matrix from the Data Analyzer 403 
and the derived quantizer scale from the Rate Control circuit (shown as item 405 in Figure 
3). The 8x8 quantized coefficients are then re-arranged in a zig-zag manner by a zig-zag 
(ZZ) circuit 703 according to the predetermined alternate _scan format parameter from the 
Data Analyzer 403. A Variable-Length Coder (VLC) circuit 704 subsequently variable- 
length encodes the one dimensional data in the chosen intra _v/c Jbrmat determined from 
the Data Analyzer 403 using run-length encoding and the Huffman table defined in the 
MPEG-2 specifications and also differential encoding of the luminance DC coefficients 
within the macroblocks. At the same time, the number of bits generated by the VLC 
circuit 704 is tracked and fed back to the Rate Control circuit 405. 

The VLC circuit 704 also ensures minimal expansion of video data on a 8x8 block basis by 
limiting the maximum number of bits for an 8x8 block to 682 bits, or by dropping the last 
few coefficients if the limit is exceeded. The reason for this is that the macroblock pointer 
has a fixed precision of 12 bits and any expansion of data is inefficient on memory savings. 
Furthermore, limiting the bit count on the expanded data rate does not have an adverse 
effect on the picture quality. The entire encoding process is similar to the MPEG encoder 
except for the absence of the motion estimator, the decoding loop, motion vectors and 
MPEG conforming bitstreams. The components in Embedded Encoder 406 can be built 
from standard components in an MPEG Encoder. 

Referring again to Figure 3, as the bitstreams from the Embedded Encoder 406 are 
generated, they are stored into the Compressed Frame Buffers 407 and the Macroblock 
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Pointer Table is updated with the new starting address of each macroblock. In the 
decoding of B-Pictures, anchors frames are required to provide the forward and backward 
prediction, giving rise to the need of at least two compressed anchor frames (I-frames or P- 
frames stored as I-Pictures) in the Compressed Frame Buffers 407. For example, with a 
5 10:1 compression scheme, the capacity of the Compressed Frame Buffer 407 will be 
approximately equal to 1 megabits (calculated by 2 frames * 0.1 being the compression 
factor * 4,976,640 bits per frame = 1 megabits). 

Memory space may be shared between the Video Bitstream Buffer 401, the Compressed 
10 Frame Buffers 407, the Still Picture Buffer (not shown) and the On-screen Display 
Graphics Buffer (not shown). The Still Picture Buffer stores a compressed still picture 
from the bitstream that may be decoded as a background picture during run time. The On- 
screen Display Graphics Buffer stores graphics including texts and logos that are overlaid 
on screen for special features, for example the channel menu. The size of the Video 
15 Bitstream Buffer 401 varies with the video bitrate, with an upper limit determined by the 
maximum bit rate of the video bitstream. The size of the Compressed Frame Buffers may 
therefore be changed for every video bitstream or for the decoding of a particular bitstream 
according to application needs and memory availability. The number of bits for a picture 
may also be dynamically allocated for maximal picture quality. 

20 

In an alternative embodiment, the present system may be extended to also perform lower 
resolution picture decoding. Figure 8 shows a modified architecture of the detector to 
support lower resolution picture or zoom-out picture decoding. The architecture in Figure 
8 involves the inclusion of a Decimation Filter 811 and an Interpolation Filter 812. All 

25 other components in Figure 8 have the same functionality as the correspondingly 
numbered components described in Figure 3. The Decimation Filter Circuit 811 performs 
a horizontal spatial decimation of the display pixels to the required resolution using a 
digital decimation filter, for example a 7 tap filter with coefficients [-29, 0, 88, 138, 88, 0, 
-29] for a 2:1 decimation, before it is encoded by Embedded Encoder 406. The 

30 horizontally down-scaled version of the picture is stored as variable-length encoded 
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bitstrearns in the Compressed Frame Buffers 407 and is decoded when necessary for 
display by the Display Decoder 408. 

An Interpolation Filter 812 is needed to perform a horizontal spatial interpolation to 
5 achieve full Dl resolution motion compensation using a digital interpolation filter, for 
example a 7 tap filter with coefficients [-12, 0, 140, 256, 140, 0, -12] for a 1:2 
interpolation. The two filters can be designed jointly and filters for luminance and 
chrominance components can be customized to maximize picture quality. These filters are 
standard components of a video pre-processor subsystem in video related application 
10 systems. 

Besides using the above filters, the Data Analyzer 403 may be adapted to support zoom- 
out modes where the Di horizontal resolution is an integer multiple, 9, of a lower 
horizontal resolution picture. The adaptation includes additional analysis being performed 
15 once for every 6 macroblocks decoded to compute corresponding parameters of the to-bo- 
displayed macroblock. Macroblock complexity and quantizer scale are averaged for 8 
macroblocks, the minimum minjjscale is selected among 9 macroblocks and the majority 
dctjype for 8 macroblocks is conformed to. 

20 The bit counts of DC and AC coefficients (for I-Pictures), d, and 7 t b respectively, are 
accumulated for every decoded macroblock as described in the earlier text. The bit count 
of the respective DC and AC coefficient in a picture (for I-Pictures) are calculated based 
on the to-be-displayed macroblock, as follows: 
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It is obvious to those skilled in the art that special considerations may be made for the 
picture boundary in the case where the width or height of the decimated picture is not an 
integer multiple of macroblocks. 

5 To reduce speed complexity issues regarding the B-on-the-Fly decoding of B-Pictures for 
low resolution display, two extra picture buffers may be included as part of the system to 
temporarily store B-Pictures. As such, B-pictures may be compressed similar to the anchor 
frame pictures as described above. The size of the Compressed Frame Buffers 407 is not 
compromised as lower resolution pictures produce acceptable picture quality at a smaller 
1 0 target picture bit count. 

Further simplification may be done to reduce decoding from a two-pass to a single-pass 
decoding process for B-Pictures. As such, the computation of the Data Analyzer 403 
during the first field of decoding is eliminated and the macroblock bit allocation scheme in 
15 the Rate Control Circuit 405 is adapted to allocate a constant or averaged target bit count 
of AC coefficients, defined by: 

r _ *p>c 
*' ~ N 

20 where N is the number of macroblocks in the low resolution picture, and the bit count of 
picture DC coefficients (and hence the target bit count of picture AC coefficients) may be 
estimated from the previous picture of the same type. 

The term "circuit" as used herein with reference to functional components is intended to 
25 include any applicable hardware componentry which can accomplish the appropriate 
function and may include processor chips and ASICs as well as basic electronic logic 
components. The "circuits" may also be implemented as modules executed in software or 
a combination of software and hardware 
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THE CLAIMS: 

1 . A method of processing video frame data, including the steps of: 

(a) receiving a video frame; 

(b) partially decoding the video frame; 

(c) fully decoding the video frame to produce macroblocks; 

(d) determining video data parameters from the partially decoded video frame or 
both the partially and fully decoded video frame; 

(e) encoding the macroblocks based on the determined video data parameters to 
provide a compressed video frame for subsequent display. 

2. A method according to claim 1, wherein the step of partially decoding the video 
frame includes variable length decoding of an input bitstream of the video frame data. 

3. A method according to claim 2, wherein the step of partially decoding the video 
frame includes variable length decoding of the input bitstream for an intra-coded video 
frame and variable length decoding of a compressed anchor video frame bitstream for 
inter-coded video frames. 

4. A method according to claim 3, wherein the said variable length decoding of a 
compressed anchor frame bitstream includes macroblock address decoding using a 
macroblock pointer table and the step (d) of determining includes determining macroblock- 
level and picture-level video data parameters. 

5. A method according to claim 4, wherein said macroblock pointer table is organised 
into video segments, each comprising n macroblocks with a full length segment pointer 
and n-l incremental segment pointers, where n is an integer. 

6. A method according to claim 4, wherein said macroblock address decoding is 
performed according to: 
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mb _ address m - segment address k + J] /h6 _ address _ wc, 

where mb_address m is the absolute macroblock address of macroblock m; 
segment jxddressk is the full segment address of segment and mbjaddressjnc, is the 
incremental macroblock address of a macroblock with a position offset / within a segment 
k\ and where / is an integer ranging from 0 to n-1 and n represents the number of 
macroblocks within a segment. 

7« A method according to claim 1, wherein step (d) includes one or more of: 

(i) • determining macroblock-Ievel and picture-level video data parameters; 

(ii) determining macroblock complexity in the video frame; and 

(iii) determining picture statistics of the video frame. 

8. A method according to claim 7, wherein said macroblock-level video data 
parameters of step (i) include one or more of: an intra coding flag, a bit count of the AC 
coefficients, a bit count of the DC coefficients, a quantizer scale, motion vectors and 
discrete cosine transform (DCT) type. 

9. A method according to claim 7, wherein said picture-level video data parameters of 
step (i) include one or more of: quantizer scale type, intra quantization matrix, intra DC 
precision, alternate scan format and intra variable length coding format. 

10. A method according to claim 7, wherein step (d) includes estimating the set of 
macroblock parameters from compressed anchor frames using a decoded motion vector. 

11. A method according to claim 10, wherein the step of estimating macroblock 
parameters from compressed anchor frames for inter-coded macroblocks includes one or 
more of: 

(iv) determining macroblock parameters including a bit count of AC 
coefficients, a bit count of DC coefficients and a quantizer scale; 
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(v) determining a discrete cosine transform (DCT) type; and 

(vi) determining a minimum quantizer scale. 

12. A method according to claim 11, wherein step (iv) is based on the maximal overlap 
principle where the macroblock assumes the characteristics of the compensated 
macroblock that is maximally overlapped. 

13. A method according to claim 1 1, wherein said determined macroblock DCT type is 
based on a majority of the DCT types used in motion compensated macroblocks for inter- 
coded macroblocks. 

14. A method according to claim 11, wherein said minimum quantizer scale is the 
minimum quantizer scale used among motion compensated macroblocks for inter-coded 
macroblocks. 

15. A method according to claim 7, wherein said macroblock complexity is determined 
as the product of the macroblock quantizer scale and the bit count of the AC coefficients of 
the macroblock. 

16. A method according to claim 7, wherein said macroblock complexity is estimated 
from the product of an estimated quantizer scale and an estimated bit count of AC 
coefficients for inter-coded macroblocks. 

17. A method according to claim 7, wherein said picture characteristics include one or 
more of default DCT type, DC compression factor, picture complexity, the picture bit 
count of AC coefficients and the picture bit count of DC coefficients. 

1 8. A method according to claim 17, wherein the default DCT type is a fixed parameter 
value assigned where equal numbers of motion vectors have DCT type. 

19. A method according to claim 17, wherein the DC compression factor is defined as 



-33- 



the picture bit count of DC coefficients of the received video frame divided by the picture 
bit count of the DC coefficients from re-encoded macrobiocks. 

20. A method according to claim 17, wherein said picture complexity is determined as 
the sum of the macroblock complexities of macrobiocks in the video frame or the sum of 
the estimated macroblock complexities of macrobiocks in the video frame. 

21. A method according to claim 17, wherein said picture bit count of AC coefficients 
is determined as the sum of the macroblock bit counts of AC coefficients or the sum of the 
estimated macroblock bit counts of AC coefficients. 

22. A method according to claim 17, wherein said picture bit count of DC coefficients 
is determined as the summed accumulation of the bit counts of DC coefficients from the 
intra-coded macrobiocks multiplied by the DC compression factor and accumulation of 
estimated bit count of DC coefficients from the inter-coded macrobiocks. 

23. A method according to claim 1 l f wherein the step of determining video parameters 
from the partially decoded video frame includes step (iv) and the step of determining video 
parameters from the fully decoded video frame include steps (iv) to (vi), excepting 
determining said bit count of DC coefficient. 

24. A method according to claim 1 1, wherein the step of determining video parameters 
from the partially decoded video frame includes step (iv) and the step of determining video 
parameters from the fully decoded video frame include steps (v) to (vi). 

25. A method according to claim 1 1, wherein the step of determining video parameters 
from the partially decoded video frame includes steps (iv) to (vi). 

26. A method according to claim 1, wherein the step (e) of encoding the macrobiocks 
includes: 

(i) allocating target encoding bits for each macroblock; 
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(ii) predicting a quantizer scale for each macroblock; 

(iii) implementing control loop feedback; and 

(iv) encoding the macroblock based on said video data parameters. 

27. A method according to claim 26, wherein the allocation of target macroblock 
encoding bits includes scaling of macroblock complexity relative to picture complexity 
with a feed back control adjustment, as described by the equation: 



where s, r is the target number of bits for encoding AC coefficients for the I th macroblock; 
% t is the estimated complexity for the t* macroblock; z m is the estimated complexity 
from current picture statistics; s T piL is the target bits for encoding all AC coefficients from 
current picture statistics; and % ptc is a proportional integral control adjustment for the 
picture level. 

28. A method according to claim 26, wherein predicting the quantizer scale includes an 
approximation of the rate quantization with a feedback control adjustment, as described by 
the equation: 



where q t is the predicted quantizer scale for the <* macroblock; estimated complexity 
th s r 

of the i macroblock; * is the target number of bits used for encoding AC coefficients for 
the I th macroblock; and g MB is a proportional integral control adjustment for the 
macroblock level. 




ptc 




29. A method according to claim 27, wherein said predicted quantizer scale is 
constrained to be above a minimum quantizer scale. 

30. A method according to claim 26, wherein said control loop feedback includes a two 
tier closed control loop with an inner loop controlling quantizer prediction accuracy and an 
outer loop compensating for bit rate accuracy. 

31. A method according to claim 28, wherein said control loop feedback is based on 
the error between the actual and target encoding bits and provides proportional integral or 
proportional control adjustments by applying the equation 

i-i 

to the steps of the oiacroblock bit allocation and quantizer scale prediction, where a and 
(3 are constants less than zero and e t is the error of the I th macroblocks, defined as the 
difference between the target and re-encoded AC coefficient bit counts. 

32. A method according to claim 27, wherein £ ptc is defined by 7]e t _ { ^y^e k where 

rj and ^are constants and e, is the error of the I th macroblocks, defined as the difference 
between the target and re-encoded AC coefficient bit counts. 

33. A method according to claim 26, wherein said encoding step (iv) comprises the 
process of forward DCT transformation, quantization and variable length coding based on 
said video data parameters, which includes the quantizer scale and a subset of one or more 
of: DCT type, quantizer scale type, intra quantization matrix, intra DC precision, alternate 
scale and intra variable length coding format. 

34. A video decoding system having means for executing the method of any one of 
claims 1 to 33. 
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35. A video decoder including: 

(a) a bitstream parser for receiving a video frame; 

(b) an embedded decoder for partially decoding the video frame and fully 
decoding the video frame to produce macroblocks; 

(c) a data analyzer for determining video data parameters from the partially 
decoded video frame or both the partially and fully decoded video frame; 

(d) an embedded encoder for encoding the macroblocks based on the 
determined video data. 

36. A video decoder system having means for supporting lower resolution picture 
decoding including: 

a video decoder as claimed in claim 35; 

a decimation filter module for receiving the decoded macroblocks and performing a 
horizontal spatial decimation of the display pixels to the required resolution using a digital 
decimation filter; and 

an interpolation filter module for receiving the decoded reference macroblocks and 
performing a horizontal spatial interpolation to achieve a full Dl resolution motion 
compensation using a digital interpolation filter. 

37. A decoder according to claim 36, wherein the data analyzer is adapted to perform 
averaging operations for the lower resolution picture decoding. 
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